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We report results from a search for the decay B^ using 1.3 fb~^ of pp collisions at 
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-^s — 1.96 TeV collected by the DO experiment at the Fermilab Tevatron Collider. We find two 
candidate events, consistent with the expected background of 1.24 ±0.99, and set an upper limit on 
the branching fraction of B{B° < 1-2 x 10"^ at the 95% C.L. 

PACS numbers: 13.20.He, 12.15.Mm, 12.60.Jv, 13.85. Qk 



The branching fraction ^"""^ ) is predicted 

to be (3.4 ± 0.5) x 10"^ [l|] within the standard model 
(SM), where the decay occurs through hehcity and CKM- 
suppressed processes involving multiple electroweak bo- 
son exchanges. In supersymmetric (SUSY) models, in- 
teractions with neutral Higgs bosons can enhance the 
branching ratio by several orders of magnitude if the 
value of tan/3, the ratio of vacuum expectation val- 
ues for the two neutral CP-even Higgs fields, is high 
0, S i, H, H- Large enhancements to S(S° Ai+M") 
are possible in SUSY models with i?-parity violating cou- 
plings even if tan /3 is low 0] • Improvements to the limit 
on B{B1 —> will constrain the parameter space of 

such models. The best published experimental bound is 
B{B° ^l+fl-) < 2.0 X 10-^ at the 95% C.L. 0. The 
analysis reported in this letter used 1.3 fb~^ of pp col- 
lisions collected by the DO experiment at the Fermilab 
Tevatron. It supercedes our previous result Q based on 
a 240 pb~^ subsample of the data. 

The DO detector [l^ features a three layer muon sys- 
tem ll| with each layer consisting of a scintillator plane 



and a three or four plane drift chamber, providing cov- 
erage for r] < |2|, where rj = — ln[tan(0/2)], and 9 is 
the polar angle with respect to the beamline. Muon 
backgrounds are low due to shielding from 1.8 T iron 
toroids located between the first and second muon de- 
tector layers, and from a 6-10 interaction length deep 
uranium/liquid-argon calorimeter located in front of the 
first layer. Charged particles are detected in the inner 
central tracking system, which consists of a silicon mi- 
crostrip tracker (SMT) and a central fiber tracker (CFT), 
both located within a 2 T superconducting solenoidal 
magnet. The CFT has eight thin coaxial barrels, each 
supporting two doublets of overlapping scintillating fibers 
of 0.835 mm diameter, one doublet being parallel to the 
beam axis, and the other alternating by ±3°. The SMT 
has four layers of double sided detectors divided into 
six longitudinal sections interspersed with sixteen radial 
disks. Each layer has a side with strips parallel to the 
beam axis; two layers have a ±2° stereo side, and two 
layers have a 90° side. Typical strip pitch is 50 — 80 /xm. 

Events were recorded using a set of single muon trig- 
gers, dimuon triggers, and triggers that selected pp inter- 
actions based on energy depositions in the calorimeter. 

—^ H~ I4] candidates were formed from pairs of 
oppositely charged muons. Each muon was required to 
have transverse momentum px > 2.5 GeV, and to have 
hits in at least two layers of the muon system, four lay- 
ers of the CFT, and three layers of the SMT. The 
candidate was required to have > 5 GeV. There is a 



large background due primarily to muons from the de- 
cay of pions, kaons, and h- or c- flavored hadrons. The 
— > M^/^^ signal is characterized by the long lifetime 
of the which results in an observable distance be- 
tween the point at which the is produced (the primary 
vertex) and the point at which it decays. The distance 
from the primary vertex to the B^ vertex in the trans- 
verse plane {Lt) was required to have an uncertainty 
(JLt < 0.015 cm and a significance Lt/ctlt > 12- The 
average Lt for signal events passing the pr requirement 
is ^ 0.1 cm. Typically ctl^ is between 0.002 and 0.009 
cm for both signal and background. The angle between 
the projections onto the transverse plane of the B'^ mo- 
mentum and the displacement from the primary vertex to 
the -B° vertex was required to be less than 15°. The dis- 
tance of closest approach S of each muon to the primary 
vertex in the transverse plane was calculated, along with 
the corresponding uncertainty ag and significance 5/as- 
The smaller of the two significances, imiii{S/as), was re- 
quired to be greater than 2.8. This removes a class of 
events in which one of the tracks is consistent with orig- 
inating from the primary vertex. A constrained fit was 
applied, enforcing the conditions that the tracks making 
up the B^ intersect in space and the three dimensional 
Bg trajectory pass through the primary vertex. The fit 
probability P{x^) is the fraction of the area of the 
distribution that lies below the value returned by the 
constrained fit. It was required to be at least 0.01. 

To further suppress the background, a likelihood ratio 
test was applied. Five variables were incorporated: 

1. isolation, defined as Pt/{Pt +J2pt) where is 
the transverse momentum of the i?^ system, and 
^ Pt is the scalar sum of the transverse momenta 
of all other tracks within a cone of AR < 1 around 
the B° system, where AR = ^(A(/))2 + (At;)^) and 
(j) is the azimuthal angle 

2. P{x') 

3. Lt/cflt 

4. min((5/CTa) 

5. m^t^, the mass of the dimuon system. 

The likelihood ratio was approximated as r = 
Y[i=i Si/ Bi where Si is the probability distribution of 
the ith variable for the signal, and Bi is the distri- 
bution for the background. The discriminant D^, — 
r/(l -|- r) takes a value between zero (background-like) 
and one (signal-like). Figure [1] shows the distribu- 
tions of Si and Bi for isolation and for functions of 
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Lt/'^Lt^ min((5/cr5), and P{x^)- The functions map 
the quantities into the range zero to one. They are 
given by hiLr/aL^) - 1 - exp[-0.057(LT/fTLr - 12)], 
/2[min((5/cr5)] = 1 - cxp[-0.093(min((5/cr5) - 2.8)], and 
h[P{x^)] = (P(x^) - 0.01)/0.99. In Fig. [2 the signal 
and background events satisfy all of the preselection cuts 
defined earlier except for the cut on Lt significance. To 
increase the statistics, the Lt significance cut was relaxed 
from twelve to five. The signal distributions Si are given 
by the histograms in Fig. [TJ These distributions are the 
result of Monte Carlo (MC) simulations using the PYTHIA 
event generator [l^] interfaced with the evtgen decay 
package 14[, followed by full GEANT v3.15 [IB] modehng 
of the detector response. The simulation was tuned to re- 
produce the momentum resolution and scale, the trigger 
efficiency, and the i?"*" meson pT distribution observed in 
data. The MC events were processed with the same event 
reconstruction used for the data. The background distri- 
butions Bi are given by parameterizations of the sideband 
data, shown in Fig. [1] The sideband data consist of can- 
didates having a dimuon invariant mass m^^ between 4.5 
and 7.0 GeV excluding the signal region. The signal re- 
gion is between 4.972 and 5.717 GeV, approximately ±3 
standard deviations around the mean of the Gaussian 
m^p distribution in the signal MC. The sideband isola- 
tion distribution was fit to a Gaussian function, and the 
other three sideband distributions were fit to the sum of 
two exponential functions. The to^^ distribution of the 
background was approximated to be flat when comput- 
ing the likelihood ratio. The distribution of Dc, for signal 
and background is shown in Fig. [2] Final candidates were 
required to have m^^ within the signal region and to sat- 
isfy > 0.949. This threshold was chosen to optimize 
the expected 95% C.L. upper bound on B{B^ /i+^^). 
Two candidates pass the final selection. 

An important feature of the background is seen in 
Fig. [3l which shows the distribution of m^^^ after var- 
ious cuts, beginning with the Lt significance cut and 
ending with D4 > 0.949. The discriminant D4 was cal- 
culated in the same way as D5 except that the variable 
Tn^ij. was omitted, thereby simulating the effect of a cut 
on D5 without biasing the distribution toward the 
mass. Two components are evident in the distribu- 
tions: a steeply falling component in the low mass region 
and a gradually falling component whose slope dimin- 
ishes as the cuts tighten. This structure was studied us- 
ing bb events generated with pythia, which reproduced 
the main features of the data. The contributions from 
particles misidentified as muons and other sources of real 
muons are small. The gradually falling component con- 
sists of events in which the two muons arise from the 
decay of separate b quarks, while the steeply falling com- 
ponent consists of events in which the two muons arise 
from decay of the same b quark, via sequential decay 
b — > c^v followed by c ^ s/i^ or from b — > ^p'X with 
■0' —>■ fifi. Higher mass "0' states may also contribute 
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FIG. 1: Signal and background distributions for four of the 
variables used in the likelihood ratio test. The signal distri- 
butions are from MC, and the background distributions are 
from the sideband data. The sideband distribution in (a) is 
parameterized as a Gaussian function. In (b), (c), and (d), 
the sideband distributions are parameterized as the sum of 
two exponential functions. 




FIG. 2: The distribution of discriminant D5 for signal and 
background. The background distribution is derived from 
events in the sidebands, folded over possible values of m^^ 
in the signal region. The signal distribution is from MC. The 
normalization of the MC is arbitrary. 



in the data. Because the same-& processes result from 
a single b quark, they have a better chance of produc- 
ing a dimuon system that forms a common vertex and 
points back to the primary vertex than do the separate-6 
processes. 

The expected number of background events in the fi- 
nal candidate sample was estimated using events from the 
data in the low and high sidebands, together with the as- 
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FIG. 3: The dimuon mass distribution at different stages in a 
sequence of cuts: (a) after Lt > 12aLT i (b) after rmn{5/as) > 
2.8 and P(x^) > 0.01, (c) after D4 > 0.5, and (d) after D4, > 
0.949. In (a) and (b) the histograms are fit to the sum of 
two exponential functions, while in (c) and (d) they are fit to 
the sum of an exponential and a constant. The signal region 
(shaded) was excluded in the fits. In (d), three entries are 
included in the signal region: the entry near the upper bound 
of the signal region has a value of D4 close to the threshold and 
fails the -D5 cut; the other two entries are the final candidates. 



sumption that the background consists of same-& events 
having an exponential mass distribution and separate-5 
events having a flat mass distribution. This model of the 
shape of the backgrounds fits the sideband regions well 
and accurately predicts the number of events in the sig- 
nal region, see Fig. [31 The slope of the exponential was 
taken from the fit in Fig.[3I^d). The fits in Figs.[3fc) and 
(d) are consistent with a flat distribution for separate-5 
events. The separate-6 distribution might still decrease 
gradually with mass after a cut on D4, but the slope is 
not well constrained by the statistics in the high side- 
band, and to neglect it is conservative in its effect on the 
branching fraction limit. Given the number of events in 
the low sideband and the slope of the exponential, the ex- 
pected contribution of same-6 events to the high sideband 
is negligible. The estimated background from separate-6 
events is J^iPi'"^ where the sum is over all events in the 
high sideband. The variable w is the expected number of 
separate-6 events in the signal region per separate-6 event 
in the high sideband, determined from the range of the 
signal region, the range of the high sideband region, and 
the shape of the mass distribution for separate-6 events. 
The variable Pi is the probability for a separate-6 event 
to pass the cut > 0.949 given that it falls within the 
signal region and has the specific value of observed 
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FIG. 4: Mass distribution of B candidates. The background 
distribution is parameterized as a parabola and the signal 
distribution as a Gaussian function. 



for the ith event in the high sideband. This probabil- 
ity was determined by integrating over the possible mass 
values in the signal region. Likewise, the background 
from same-6 events was computed using the correspond- 
ing sum over events in the low sideband. However, the 
low sideband contains separate-6 events as well as same-6 
events. As a result, the low sideband sum is an overes- 
timate of the same-6 background. The contribution due 
to separate-^ events in the low sideband was estimated 
using the high sideband data and subtracted. The total 
estimated background is 1.24 ± 0.99 ± 0.08 events, where 
the first uncertainty is statistical and the second is due 
to the uncertainty in the shape of the m^^ distribution. 

The branching fraction was obtained by normalizing 
to the number of i?+ J/i/jK'^ — > fi^fi^K^ candidates 
observed in the data. i?+ candidates were formed in a 
similar fashion to the candidates, but with the addi- 
tion of a third track, which was assumed to be a kaon and 
required to have > 1-0 GeV. The three tracks had to 
form a common vertex, and the two muons had to have 
a mass near the J/tp mass. As with 5° candidates, the 
muon pair was required to have min{6/as) > 2.8. The 
B'^ system had to pass the samepT, angle, ctlt, Lt/<JLti 
and P{x^) cuts as the B^ system. Finally, the B'^ sys- 
tem was required to have D4 > 0.949. The number of 
5+ decays 71^+ = 2016 ± 55 (stat) ± 45 (syst) was deter- 
mined from the fit to the reconstructed mass distribution 
shown in Fig. H) 

The branching fraction is related to ng+ by 



npo tB+ f{b B+) 
nB+ ' eso ' /(6^ B^) 
B{B+ J/tpK+) ■ B{J/ij 



(1) 



which is obtained by eliminating the integrated lumi- 
nosity and b quark production cross section from the 
expressions for the B~^ and B" yields. The quantity 
ngo is the number of i?" — > /i"*"/^" decays observed in 
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the data. The efhciencies eB+ and e^o are, respectively, 
the fractions of — > J/ipK^ ji^ ji^K'^ decays and 
ji^ ^~ decays that are observed in the MC. The 
ratio eB+ /(-b° is 0.172 ± 0.015, where the sources of un- 
certainty include the dimuon mass resolution and scale, 
the shape of the discriminant distribution, trigger effi- 
ciency, MC statistics, and the shape of the pr distribu- 
tion for B^ and B'^ . The B meson production ratio was 

calculated to be ^j^^J = 3.86 ± 0.54 from the produc- 

tion fractions of Refs. [16|, 117| and the correlation coef- 
ficient from Ref. ^V?\. The branching fractions B{B^ 
J/'>l)K+) = (1.008 ±0.035) X 10-3 and S(J/V' ^ M+M") = 
0.0593 ± 0.0006 are from Ref. 0. The product of the 
factors multiplying ubo on the right hand side of Eq.[l]is 
therefore fc = B{B° ^)i+^-)/nBO = (1.97±0.34) x 10-^ 
often called the single event sensitivity. The contribu- 
tions of the various sources of uncertainty to the relative 
uncertainty in k are listed in Table [D 



Source 



Afc/fc 



Mass resolution 0.007 

Mass scale 0.013 

Discriminant distribution 0.030 

Trigger efficiency 0.007 

MC statistics 0.024 

B meson pr spectrum 0.080 

f{h^B+)/f{h-^B'i) 0.140 

B{B+ ^ J/^PK+) 0.035 

B{J/ip ^ fi+fi-) 0.010 

B+ fit (stat) 0.027 

B+ fit (syst) 0.022 



Combined 



0.17 



TABLE I: Sources of uncertainty and their contributions to 
the relative uncertainty in the single event sensitivity k. 



Uncertainties due to differences between the data and 
MC largely cancel in the ratio / ego , although not 
completely. For instance, muons from i?^ decay 
mostly have higher than muons from B^ J/ipK'^ — > 
fj,^ decay, in which the energy is shared among 
three particles. The resulting effect on the efficiency of 
the trigger and muon px cuts depends on the px distribu- 
tion of the parent B mesons, and the shape of this distri- 
bution is the dominant source of uncertainty in e b+ /e b° ■ 
The extra track in decays together with better track- 
ing and vertexing in the MC than in the data result in 
an overestimate of 6^+ /eso and a slight worsening of the 
limit. The uncertainty due to modeling of the first four 
likelihood variables was estimated to be 3% based on a 
comparison between data and MC. The uncertainties 
due to the mass resolution (0.7%) and scale (1.3%) were 
estimated by comparing the T(liS') iX^ mass distri- 
bution in data and MC. Other uncertainties in eB+ 
are MC statistics (2.4%) and trigger efficiency (0.7%). 



Given two candidates observed in the data, an upper 
limit on n^o was computed taking into account the ex- 
pected background and uncertainties using a Bayesian 
method. The resulting upper limit on the branching frac- 
tion is S(B0 ^ < 1.2 X 10-^ at the 95% C.L. 
The expected limit is 0.97 x 10^^. This result improves 
upon the best previously published upper bound for this 
branching fraction Q . 
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